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Abstract 

This article studies the effect of discretisation error on the stationary dis- 
tribution of stochastic partial differential equations (SPDEs). We restrict the 
analysis to the effect of space discretisation, performed by finite element schemes. 
The main result is that under appropriate assumptions the stationary distribu- 
tion of the finite element discretisation converges in total variation norm to the 
stationary distribution of the full SPDE. 
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Introduction 



In this article we consider the finite element discretisation for stochastic partial dif- 
ferential equations (SPDEs) of the form 

d t u(t,x) = d%u(t,x) + f(u(t,x)) +V2d t w(t,x) V(t,x) G [0,oo) x [0,1], (1) 

where dtw is space-time white noise and / : K — > R is a smooth function with bounded 
derivatives, and the differential operator d% is equipped with boundary conditions such 
that it is a negative operator on the space L 2 ([0, 1],MJ. More specifically, we are con- 
sidering the effect that discretisation of the SPDE has on its stationary distribution. 

Our motivation for studying this problem lies in a recently proposed, SPDE-based 
sampling technique: when trying to sample from a distribution on path-space, e.g. in 
filtering/ smoothing problems to sample from the conditional distribution of a process 
given some observations, one can do so using a Markov chain Monte Carlo approach. 
Such MCMC methods requires a process with values in path-spa ce and it transpires 



that in so me situations SPDEs of the form ([1} can be used, see e.p. lHairer et al.l |2005, 
20071) and lHairer etal] (|2009t) for a review. When implementing the resulting meth- 
ods on a computer, the sampling SPDEs must be discretised and, because MCMC 
methods use the sampling process only as a source of samples from its stationary 
distribution, the effect of the discretisation error on an MCMC method depends on 
how well the stationary distribution of the SPDE is appro ximated. While there are 
many results of approximation of trajectories of SPDEs (e. g. Millet and Morien . 2005; 
Walshl . l2005t iHausenblasl l2008t iGvongy and Milled . l2009t I JentzenT 120111 ). approxim- 



ation of the stationary distribution seems not to be well-studied so far. 

When discretising an SPDE, discretisation of space and time can be considered 
to be two independent problems. In cases where only the stationary distribution of 
the process is of interest, Metropolis sampling, using the next time step of the time 
discretisation as a pro posal, can be used to completely eliminate the error introduced 



by time discretisation (jBeskos et al 



20081 ). For this reason, in this article we restrict 
the analysis to the effect of space discretisation alone. The discretisation technique 
discussed here is a finite element discretisation, which is a much-studied technique 
for deterministic PDEs. The approximation problem for stochastic PDEs, as studied 
in this article, differs from the deterministic case significantly, since here we have to 
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compare the full distribution of the solutions instead of considering the approximation 
of the solution as a function. 

While the results of this article are formulated for SPDEs with values in K., wc 
expect the results and techniques to carry over to SPDEs with values in R d ,d > 1 
without significant changes. We only restrict discussion to the one-dimensional case 
to ease notation. This is in contrast to the domain of the SPDEs: we consider the case 
of one spacial dimension because this is the relevant case for the sampling techniques 
discussed above, but this choice significantly affects the proofs and a different approach 
would likely be required to study the case of higher-dimensional spatial domains. 

The text is structured as follows: In section [T] present the required results to 
characterise the stationary distribution of the SPDE (TTJ) . In section [2] wc introduce 
the finite element discretisation scheme for ([1]) and identify the stationary distribu- 
tion of the discretised equation. Building on these results, in section [31 we state our 
main result about convergence of the discretised stationary distributions to the full 
stationary distribution. Finally, in section 21 we give two examples in order to illus- 
trate the link to the MCMC methods discussed above and also to demonstrate that 
the considered finite element discretisation forms a concrete and easily implemented 
numerical scheme. 



1 The Infinite-Dimensional Equation 

In order to study the SPDE (TTJ) , it is convenient to rewrite the equation as an evolution 
equation on the Hilbert space % — L 2 ( [0, 2tt] , R d ) ; For a description of the under lying 
theory we refer, for example, to the monograph of lDa Prato and Zabczvkl ( 19921 ). We 
consider 

du{t) = Cu(t)dt + f(u{t)) +V2dw(t) yt>0 (2) 

where the solution u takes values in % and / acts pointwise on u, i.e. f(u)(x) 
' for almost all x G [0, 1] for some function /: R d — s- R d , such that / maps 

H into itself. Furthermore, w is an L 2 -cylindrical Wiener process and we equip the 
linear operator C = 9 2 with boundary conditions given by the domain 

V(C) = {ue H 2 ([0,1],R) | a u(0) - Pod x u(0) = 0, a x u(l) + Pid x u{l) = °} ( 3 ) 

where ao, ax,Po, Pi G R- The boundary conditions in ^ include the cases of Dirichlet 
(Pi = 0) and v. Neumann (pn — 0) boundary conditions. The general case of at, Pi ^ 
is known as Robin boundary conditions. 

We start our analysis by considering the linear equation 

du(t) = Cu(t) dt + V2dw(t) Vt > 0. (4) 

For equation Q to have a stationary distribution, we require C to be negative definite. 
The following lemma states necessary and sufficient conditions on on and ft for this 
to be the case. 

Lemma 1.1. The operator £ is a self-adjoint operator on the Hilbert space T-L. The 
operator C is negative definite, if and only if «0; Po, Pi are contained in the set 



.4 



{Po(a o +Po)>0,P 1 (a 1 +p 1 )>Q,\(a o +p o )(a 1 +p 1 )\ > \p Pi\] 
U {/3 = 0, a + 0, px(ax + p x ) > o} U {/3 (a + p ) > 0, p 1 = 0, at ^ o} 

u{/3o = 0,a ^0, p x =0,ax ^ o}. 

proof. From the definition of C it is easy to see that the operator is self-adjoint. 

We have to show that £ is negative if and only if (ao, Po, ax, Px) G A Without 
loss of generality we can assume Pi > for £ = 1,2 and ai > whenever Pi = (since 
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we can replace (aj,ft) by (—a,, —ft) if required) . Assume that A is an eigenvalue of 
C. If A > 0, the corresponding eigenfunctions are of the form 

u{x) = cie^ + CBe _VXa 

where c\ and C2 are given by the boundary conditions: For u to be in the domain of 
£, the coefficients c\ and C2 need to satisfy 

/ a - /3 Q V\ a + PoV\ \ fcA = fo 

\( ai + frVX)^ ( ai -ftVA)e-^J W V° 

Non-trivial solutions exist only if the matrix is singular or, equivalently, if its determ- 
inant 

/(A) = a ai + (aoft +«i/3o) vAcothVA + ft)ftA (5) 

satisfies /(A) = 0. For A = the eigenfunctions are of the form it(x) = cxl + c-ix 
and an argument similar to the one above shows that the boundary conditions can 
be satisfied if and only if a^a\ + aoft + aift> — 0. Since x coth(x) — > 1 as x — > 0, this 
condition can be written as /(0) = where 

/(0) = lim/(A) = a ai + a ft + aift. 

A4^0 

This shows that C is negative whenever /(A) ^ for all A > 0. 

Let (ao, ft, ai, ft) G A. Assume first ft ^ for i = 1, 2 and let & = aj/ft. Then, 
by the first condition in A, we have 60161 > — 1 and (Co — l)(£i — 1) > 1) an( l for 
A > we get 

/(A) = 6o£i + (Co + 6) TAcothA/A + A > + + 1) - 1 > 0. 

The cases ft — or ft = can be treated similarly. Thus, for (ao, ft, ai, ft) G A 
there are no eigenvalues with A > and the operator is negative. 

For the converse statement, assume that (ao,ft, ai, ft) ^ A. We then have to 
show that there is a A > with /(A) = 0. Assume first ft > for i = 1,2 and define 
& as above. If (£„ + l)(6i + 1) = 1, we have /(0) = 0. If (£„ + l)(Ci + 1) < 1, the 
function / satisfies /(0) < and /(A) — > oo as A — > oo; by continuity there is a A > 
with /(A) = 0. Finally, if (6o + l)(6i + 1) > 1 but Co, 6 < -1. we have /(0) > 
and for A with VX = -(Co + 60/ 2 > we find /(A) < 6061 + (6o + 6i) VA + A = 
6061 - (Co + 60 V 4 = -(Co - 60 2 /4 < and by continuity there is a A > with 
/(A) = 0. Again, the cases ft = and ft = can be treated similarly. | 

A representation of the eigenvalues of C which is similar to the one in the proof 
of lemma [TTT1 can be found in section 3 of ICacciapuoti and Fined ( 201dt ). 



The statement from lemma ITTTI reproduces the well-known results that the Lapla- 
cian with Dirichlet boundary conditions (a,; = 1,/% = 0) is negative definite whereas 
the Laplacian with von Neumann boundary conditions (a, = 0, ft = 1) is not (since 
constants are eigenfunctions with eigenvalue 0). 

Lemma 1.2. Let C be negative definite. Then the following statements hold: 

1. The linear SPDE (0]) has global, continuous H-valued solutions. 

2. Equation ((4]) has a unique stationary distribution v on %. The measure v is 
Gaussian with mean and covariance function 

C(x, y) = Wisg + /Wl -*)(!- tf) + x a _ 
a ai + a ft + ftai 

where x A y denotes the minimum of x and y. 

3. The measure v coincides with the distribution of U € C([0, 1],R) given by 

U{x) = (1 - x)L + xR + B{x) Vx G [0, 1] , 
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where L ~ Af(0, R ~ A/"(0,crfj) with Cov(L,R) — glr, the process B is a 
Brownian bridge, independent of L and i?, and 



(oq + A))/3i 



a ai + a /?i + /3 ai 



P0P1 



a ai + a>o0i + (3 ai 

proo f. From Iscoe et al. (|l990l) and Da Prato and Zabczvk (jl996l) (see Hairer et al.l 



2005, Lemma 2.2) we know that (j4]) has global, continuous "H-valued solutions as well 



as a unique stationary distribution given by v — 7V(0, — C~ l ). An easy computation 
shows that C as given in equation ([5]) is a Green's function for the operator — C, i.e. 
—d%C(x, y) — S(x — y) and for every y g (0, 1) the function x C(x, y) satisfies the 
boundary conditions This completes the proof of the first two statements. 

For the third statement we note that U is centred Gaussian with covariance func- 
tion 

C(x,y) = Cov(U(x),U(v)) 

= Cov((l - x)L + xR + B{x), (1 - y)L + yR + B(y)) 

= (1 - x)(l -y)al+ ((1 - x)y + x(l - y)) a LR + xy a\ 
+ x A y — xy. 

The fact that this covariance function can be written in the form can be checked 
by a direct calculation. I 

Using the results for the linear SPDE (@| we can now study the full SPDE 
The result is given in the following lemma. 

Lemma 1.3. Let C be negative definite. Furthermore, let / = F' where F £ C 2 (R, K) 
is bounded from above with bounded second derivative. Then the following statements 
hold: 

1. The nonlinear SPDE @ has global, continuous H-valued solutions. 

2. Equation @ has a unique stationary distribution fi which is given by 



^( u ) = ^ cx p(y F(u(x))dx 



where v is the stationary distribution of (j4]) from lemma 11721 and Z is the norm- 
alisation constant. 

proof. This result is well known, see e.g. Zabczvkl ( 1989h or Hairer et al. ( 2007 . 
corollary 4.5). I 



2 Finite Element Approximation 



In this section we consider finite dimensional approximations of the SPDE (J2J, ob- 
tained by discretising space using the finite element method. The approximation 
follows the same appro ach as for determin i stic P DE s. For backgrou nd on the determ- 
inistic case we refer to Brenner and Scott ( 2002 ) or Johnson! (1990). 

To discretise space, let n £ N, Ax — 1/n and consider x- values on the grid kAx for 
k G N. Since the differential operator C in © is a second order differential operator, 
we can choose a finite element basis consisting of "hat functions" ipi for i e Z which 
have (fi(iAx) = 1, <pi(J Ax) — for all j i, and which are affine between the 
grid points. Formally, the weak (in the PDE-sense) formulation of SPDE @ can be 
written as 

(v, du(t)) = B(v, u )dt + (v,f(u(t))) + V2(v,dw(t)) 
where ( • , • ) denotes the L 2 -inner product and the bilinear form B is given by 



B(u,v) = (v,Cu) = u(l)v'(l) - u(0)v'(0) 



u'{x)v'{x) dx. 
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The discretised solution is found by taking u and v to be in the space spanned by the 
functions ifi, i.e. by using the ansatz 

u(*) = £tfi(*to 

3 

and then considering the following system of equations: 

(Vii^dUjPj) = ((fi^^Ujw) dt + (fijQ^Ujipj)) dt + y/2{<pi,dw). (7) 

3 3 3 

The domain V of the bilinear form B depends on the boundary conditions of £; 
there are four different cases: 

1. If /3q,/3i ^ in l[3"]). i.e. for von Neumann or Robin boundary conditions, we 
have V — H ([0,1], RJ and we consider the basis functions (fi for i G 7 = 
{0,1,. ..,n- l,n}. 

2. If (3q — and fi\ ^ 0, i.e. for a Dirichlet boundary condition at the left boundary, 
we have V = { u G H 1 ([0, 1], R) | u(0) = 0} and we consider the basis functions 
tpi for i G 7 = {1, ... ,n— 1,71.}. 

3. If /?o 7^ and /?i = 0, i.e. for a Dirichlet boundary condition at the right 
boundary, we have V — {u € H 1 ([0, 1],M) | u(l) = 0} and we consider the basis 
functions tpi for i G 7 = {0, 1, . . . ,n — 1}. 

4. If /3q, Pi — 0, i.e. for Dirichlet boundary conditions at both boundaries, we have 
V = {u € H 1 ([0, 1],R) I u(0) = u(l) = 0} and we consider the basis functions 
tpi for i G 7 = {1, . . . , n — 1}. 

Throughout the rest of the text we will write 7 for the index set of the finite element 
discretisation as above, and the discretised solution u = J2jei Uj^j will be described 
by the coefficient vector [/el'. In all cases we define the "stiffness matrix" L^ n ' G 
R. /x/ by — B{(fi, ipj) for all i,j G 7. For the given basis functions we get 



2 
Ax 




if i = j 4- 


{0,n}, 


1 

Ai 




if i € { j - 


-U + i}, 


1 

Ax 


ao 
do 


if i = j = 


o, 


1 

Ax 


"i 

Si 


if i=j = 
else, 


n, 



where the cases i = j = and i = j = n cannot occur for Dirichlet boundary 
conditions. The "mass matrix" M G R /x/ is defined by My = (ipi,ipj) and for 
i, j G 7 we get 

f|Ax ifi = j£{0,n}, 
= l|Ax ifiG{j-l,i + l}, 
" ||Ax ifz=jG{0,n}, 
[0 else, 

where, again, the cases i = j = and i = j = n don't occur for Dirichlet boundary 
conditions. We note that the matrix L^ n > only has the prefactor l/Ax instead of the 
1/Ax 2 one would expect for a second derivative. The "missing" Ax appears in the 
matrix M. 
Since 

Cov({(pi,w),{(pj,w}) = (<Pi,<Pj) = Mij, 
equation can be written as 

M dU t = L {n) U t dt + f n (U t ) dt + V2M 1/2 dW t 
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where /„ : M. 1 — > R 1 is defined by 

f n (u)i = (<Pi,f(^2uj<pj)) (8) 

for all u € R 7 and i € I. Multiplication with M" 1 then yields the following SDE 
describing the evolution of the coefficients (£/i)i£j: 

Definition 2.1. The finite element discretisation of SPDE is given by 

dU t = M^L^Ut dt + M^fniUt) dt + V2M- 1/2 dW t (9) 

where W is an |/|-dimensional standard Brownian motion, I C {0,1,..., n} is the 
index set of the finite element discretisation, and LW and M are as above. 

Our aim is to show that the stationary distribution of © converges to the sta- 
tionary distribution of the SPDE ^ . We start our analysis by considering the linear 
case / = 0. For this case the finite element discretisation simplifies to (ITU1) below. 

Lemma 2.2. Let C be negative definite. Then v n = A/Y0, (— L^) -1 ) is the unique 
stationary distribution of 

dU t = M^L^Ut dt + V2M- 1/2 dW t . (10) 

proof. Since £ is a negative operator, the matrix LW is a symmetric, negative 
definite matrix. As the product of a positive definite symmetric matrix and a negative 
definite symmetric matrix, M~ x L^ n ' is negative definite; its eigenvalues coincide with 
the eigenvalues of 

M -l/2 L ( n ) M -l/2 = _((_£(»))1/2 M -1/2)T ((_i(™))V2 M -l/2). 

From Arnold (|197^ . theorem 8.2.12) we know that then the unique stationary distri- 
bution of the SDE (fTU|) is Af(0,C^) where C^™' solves the Lyapunov equation 



M- l L {n) C {n) + C {n) L {n) M- 1 = -2M 



-l 



By theorem 5.2.2 of lLancaster and Rodman! (|1995I ). this system of linear equations 
has a unique solution and it is easily verified that this solution is given by — 

The following lemma shows that for / = there is no discretisation error at all: 
the stationary distributions of the SPDE projected to M. 1 , and of the finite element 
discretisation ([9]) coincide. 

Lemma 2.3. Define II: C([0, 1],R) -t R 1 by 

(n«), = u(iAx) Vi e i. (n) 

Let v be the stationary distribution of the linear SPDE ^ on C([0, 1] , K.) and let v n 
be the stationary distribution of the linear finite element discretisation (flOl) . Then 
we have 

v n = vo n _1 

for every n 6 N. 

proof. Let C cxact be the covariance matrix of i/oll -1 and let C' n ' be the covariance 
matrix of v n . Since both measures under consideration are centred Gaussian, if suffices 
to show C oxact = C (n) . By lemma O the matrix C cxact satisfies 

C cxact = C ( iAXi jAx) Vi, j e I 

where C is given by equation ([5]). By lemma |2"T2"1 we have — (— ZA n )) _1 . A simple 
calculation, using the fact that both C exact and Z,( n ) are known explicitly, shows 
C oxact L(") = -I and thus C oxact = (the four different cases for the boundary 

conditions need to be checked separately). This completes the proof. I 



G 



The preceding results only consider the linear case and for the general case, in the 
presence of the non-linearity /, we can of course no longer expect a similar result to 
hold. As a starting point for analysing this case, we reproduce a well-known result 
which allows to identify the stationary distribution of the discretised finite element 
equation. 

Lemma 2.4. Let F € C 2 (R d ,K) with bounded second derivatives and satisfying the 
condition Z = J Rd e 2F ^ dx < oo. Furthermore, let A G R dxd be invertible. Then the 
SDE 

dX t = AA T VF(X t ) dt + AdW t (12) 
has a unique stationary distribution which has density 

<p(x) = ie^W 
with respect to the Lebesgue measure on M. d . 

proof. Define G(y) — F(Ay) for all y £ M. d . By the assumptions on F we have G E 
C 2 (K d ,R) with bounded second derivatives and Z G = L d e 2G ^ dy < oo. Therefore, 
the SDE 

dY t = VG{Y t )dt + dW t 
has a unique stationary distribution with density 

Zg 

Since VG(y) = A T \7F(Ay), we have 

dY t = A T VF(AY t ) dt + dW t 

and multiplying this equation by A gives 

d(AY t ) = AA T VF(AY t ) dt + AdW t . 

Consequently, X t = AY t satisfies the SDE (fT2l and has a unique stationary dis- 
tribution with density proportional to ?p(A~ 1 x) oc e 2G ^ A x ^ — e 2F ^ x \ Since this 
function, up to a multiplicative constant, coincides with ip, the process X has sta- 
tionary density (p. I 

Because the stationary distribution in the lemma does not depend on A, the sta- 
tionary distribution of (|12l) does not change when we remove/add A from the equa- 
tion. The process of introducing the matrix A is sometimes called "preconditioning 
the SDE" . 

In cases were we are only interested in the stationary distribution of a discretised 
SPDE, the argument from lemma 12.41 allows us to omit the mass matrix M from 
the finite element SDE ©. In particular we don't need to consider the potentially 
computationally expensive square root M 1 / 2 in numerical simulations. 

Lemma 2.5. Let C be negative definite. Furthermore, let / — F' where F £ C 2 (IR, M) 
is bounded from above with bounded second derivative. Then the finite element 
SDE © has a unique stationary distribution \i n given by 

^ = J- exp (F„) (13) 



where 

F n (u) 

'jei 

Z n is the normalisation constant and v n is the stationary distribution of the linear 
equation from lemma 12.21 



r 1 

** Ar- J 
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proof. Let = iu T L^u + F n (u) for all u e R 1 . Then 

= (L^u) t + (^,F'(J2^m(t))) = /„(«)). 

for all i £ I and thus © can be written as 

dU t = Af" 1 V$([/ t ) dt + V2M~ 1/2 dW t . 



By lemma [2741 this SDE has a unique stationary distribution fi n whose density w.r.t. 
the |/|-dimensional Lebesgue measure A is given by 



dfl n 
d\ 



(u) = ie*W = J_ exp(-i M T (-L(»))u + F„( U )). 



From lemma [2~2l we know that the density of v n w.r.t. A is 

1 



dX X ~ (2 7 r) |/|/2 (det(-i(«))) 



-exp 



(-i, T (-L(«))x) 



and consequently the distribution /i n satisfies 

dn n dv r , 

-dx {x)/ ^x 



^L( x ) = *g.(x)/*g.( x ) oc exp(F„). 



Since the right-hand side, up to constants, coincides with the expression in (|13p . the 
proof is complete. I 



3 Main Result 

Now we have identified the stationary distribution of the SPDE (in section [TJ and of 
the SDE (in section [5]), we can compare the two stationary distributions. The result 
is given in the following theorem. 

Theorem 3.1. Let /x be the stationary distribution of the SPDE © on C([0, 1],R). 
Let \i n be the stationary distribution of the finite element equation out 7 . Let 
C be negative and assume f = F' where F € C 2 (K) is bounded from above with 
bounded second derivative. Then 



on- 1 



Mr, 



I TV 



as n — > oo, where || • ||tv denotes total- variation distance between probability distri- 
butions on R 1 . 

Before we prove this theorem, we first show some auxiliary results. The following 
lemma will be used to get rid of the (not explicitly known) normalisation constant Z n . 

Lemma 3.2. Let (f2, J 7 , fi) be a measure space and /i, /2 : £1 — >■ [0, oo] integrable with 
Zi = J fi dfi > for i = 1, 2. Then 



h__h_ 

Z\ Z-2 



dfi < 



max(Zi, Z2 

proof. Using the L 1 -norm ||/|| = J |/| d/j, we can write 



h 


< 


fl 


h 


+ 


h 


h 


z 2 


Zi 


Zi 




Zx 


Z 2 



-7T\\f\ — fl\ 
^1 



\z 2 -z x \ 

Z\Z2 



Since Zi = ||/,|| we can conclude 



h_ h 
Z\ Z2 



< ' || A . A || + JA!HM S >„ , 
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where the second inequality comes from the inverse triangle inequality. Without loss 
of generality we can assume Z\ > Zi (otherwise interchange f± and f% in the above 
argument) and thus the claim follows. I 

Lemma 3.3. Let /j, and v be probability measures on C([0, 1],R) with (i<Ci/ and let 
II: C([0, 1],R) -> R 1 be the projection from (JTTJ) . Then fj, a IU 1 < 1/ o IU 1 and 

y°n- 1 ) on = E,(^|n). 
dfi/on- 1 ) v c/> 1 ; 

proof. Let f = Since E(<^|n) is Il-measurable, there is a function ip: R — > R 
with E(<p|II) = ^ o II. Let ACKbe measurable. Then 



c([o,i], 



iponi n -i( A )di> = E(tp\Tl)l n -i {A) dv 
Jc[[o.i].m) 

([0,l],Kj 



by the definition of conditional expectation. This shows that tp is indeed the required 
density. I 



proof (of theorem [OJ- Let II, v and v n as in lemma [231 Using lemmat a 1 2 . 3 1 and 1 3 . 3 
we find 



I M ° n 1 — fi r . 



I TV 



d/i o II 1 



E, 



< 



dv n dv n 

— r- O li O II 

dv oH 1 dv n 

,dfl dfl n , . 

e„(- — - — on n 

dv dv n 1 
d/i _ dji^ q 
dv dv n 



(14) 



From lemma [TTBI we know 



Lemma 12.51 gives 
and by the definition of i 7 ^ we have 



^ = ^exp(F„), 

ai> n Zj n 



where C/„ = IT(?7)j(y9j for all ?7 € C([0, 1],R) and <pj, j £ I are the finite element 
basis functions. Using lemma |3~21 we get 



UoII -/i„ 



TV 



< E, 



< 



dp _ d^n q n 
dv dv„ 



exp 



(/ F(U x )dx)-expU F(U^ n) )dxj dv{U) 



Since the inequality \e x — l| < |x| exp(|a;|) holds for all x € R, we conclude 



1/iO n 1 - /i n | 



TV 



2 



(e*p(j[ F(C/|")) di) • |exp(^ F(C/ X ) - F(C/W) 
< |e fexp(^ F(U<p)dx) 



dx - 1 



F(/7 X ) - F(C/W) dz 



• exp 



F(C/ X ) - F(C/i")) dx| 
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1/n 2/n 



1 x 



Figure 1: Illustration of the convergence of to U. Under the distribution v, the 
path U is a Brownian Bridge with random boundary conditions. Since U^""' is the 
linear interpolation of U between the grid points, the difference U^ n ' — U consists of 
a chain of n independent Brownian bridges. 



where U is distributed according to the Gaussian measure v. Since F is bounded from 
above we can estimate the the first exponential in the expectation by a constant. Using 
the Cauchy-Schwarz inequality we get 



I TV 



F(U a )-F(U<ri)dx ■ exp(\[ F(U x )-F(U^)dx\) (15) 

2 \ ,/n ' 2 



Loll 1 - Hr 



< Cl 



for some constant c±. 

The main step in the proof is to estimate the right-hand side of [T5] by showing 
that \Jo F(U X ) - F{U x n) )dx\ gets small as n — > oo. By lemma 11.21 the path U 
in stationarity is just a Brownian bridge (with random boundary values) and, by 
definition, U^ n > is the linear interpolation of the values of U at the grid points (see 
figured] for illustration). Thus, the difference — U can be written as 



" 1 



« 



-(t-i) 



where B^\ . . .,BW are standard Brownian bridges, independent of each other and 
of U^ n \ Using Taylor approximation for F we find 



F(U X ) - F(U^) dx 

f(U^)(U x -U^)dx 



< 



For the term \P n \ we find 



\F"\ 



(U x -U x n) ) 2 dx 



= ■ \Pn\ + gll^'llooQn. (16) 



n r l/n -, " pi 

i=i J0 v i=i J0 

where B^' are the Brownian bridges defined above. As an abbreviation write fi(y) = 
fjUi-l | y , )■ Conditioned on the value of U^ n \ the integrals fi(y)By dy are 



centred Gaussian with 
Varf 



(J fi(y)B^dy 



f r "") = / MV) I (yAz~yz)f l (z)dzdy 



<c 2 ||/^<cf(||^")|U + l) : 



10 



for some constants C2 , C3 > where the last inequality uses the fact the / is Lipschitz 
continuous. We get E(P„ | H(U)) — and, since the B^' are independent, 

E(P„ 2 |C/ (n) ) <^(l|t/ (n) lloo + l)V 2 . 

Using the tower property for conditional expectations, and using Hf/^Hoo < ||£^||oo, 
we get 

E(F r ?)<c^((||L/|| 00 + l) 2 )n- 2 . 

Since U is a Gaussian process, ||||f ||oo + l|L is hnite, and we can conclude 

E(,P 2 ) < c\n- 2 

for some constant C4. Similarly, for Q n we find 

n „i 

Q« = E / (B^fdyn- 2 (17) 
and thus, using independence of the B^' again, 

for some constant C5. Combining these estimates we get 

F(U a ) -F(llW)dx\\ 2 = \\Pn\\ 2 +~\\F"\\J\Q n \\ 2 < c 4 n~ 1 + c 5 n" 3 / 2 (18) 



and thus we have shown the required bound for the first factor of JT| 

Finally, we have to show that the second factor in (|15[) is bounded, uniformly in n: 
From (fT()|) we get 



exp 



F(U X ) - F(U<ri) dx\j J < E(exp(2|P„| + ||F"||ooQ„; 



1/2 



< ||e 2 l p "l||y 2 -||ell F "ll-^||' /2 . (19) 



It is easy to check that, for all a > 0, an Af(0, <7 2 )-distributed random variable X 
satisfies the inequality E(e' x l) < 26°" I 2 and thus we have 

|| e 2|P„|||l/2 =E(c 4|P„| ) l/4 < 2exp(8c 2 n - 2) < 1 (2Q) 

for all sufficiently large n. Furthermore, using (Tl7)) and the fact that the B^' are 
i.i.d., we find 

F"||ocQ„ ||V2 = i,/™/,!! _ _ I o(l)|2 n -2\Y /4 



l e 112 



exp(2||F"||oo|S (1) |^n- 2 )) (21) 

where we write |- |l2 for the L 2 -norm on the space L 2 ([0, 1], M) . By Fernique's theorem 
(|Ferniquel . Il970h there exists an e > with E(exp(e |jSW| 2 2 )) < 00. For all A > we 
have 

p 00 poo 

E(e A l B<1) &) = / P(e A l B<1) & > a) da < 1 + / F(|i? (1) |^ > 6) Ae Ab db 



and using Markov's inequality P(|BW|£ 2 > 6) < E(e £|s<1)| L 2 )e- efc we get 

E(e A l s<1> lL 2 ) < 1+ / E(c^ Bil) \h)e-c b \e Xb db=l + —^-E(e^ BW \h) 
Jo £ - A 

for all A < e. Substituting this bound into (|2"Tj) we have 

|| C I|F"UQ„||V 2 < ( 1 + £|)«< 2 (22) 
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for some constant cq and all sufficiently large n. From (|2U|) and (f2"2"j) we see that the 
right-hand side of (|19[) is bounded uniformly in n, i.e. 



exp 



F(^) -F(C/|"))dar| 



<c 7 



(23) 



for all n £ N and some constant cj. 

Combining (TT51) and ([23)1 we see that the right-hand side in (H3|) is of order C(n _1 ). 
This completes the proof. I 

In the preceding theorem we compared the stationary distribution [i n of the finite 
element SDE on R 1 and the stationary distribution ju of the SPDE on C([0, 1], K) by 
projecting fj, onto the finite dimensional space M. 1 . An alternative approach is to embed 
M. 1 into C([0, 1],M) instead. A naive implementation of this idea would be to extend 
vectors from Wi 1 to continuous functions via linear interpolation. Unfortunately, the 
image of \x n when projected to C([0, 1],K.) in this way would be mutually singular 
with (i and thus the total variation norm would not provide a useful measure for the 
distance between the two distributions. For this reason, we choose here a different 
approach, described in the following definition. 

Definition 3.4. Given a probability measure fi n on M. 1 , we define a distribution (i n 
as follows: Consider a random variable X which is distributed according to fi n . Given 
X, construct Y € C([0, 1],R) by setting Y(kAx) = Xk for k = 0, 1, . . . , n and filling 
the gaps between these points with n Brownian bridges, independent of X and of 
each other. Then we denote the distribution of Y by jl n . 



Lemma 3.5. Let fi n and v n be probability measures on 
An v n with 



I 1 with |Lt n <C v n . Then 



dp, n 



dfJm 
dv n 



on 



on C([0,1],M) 
proof. Let i\) 



Using substitution we get 



E An (/on)= f fdn n = f /^^„ = E c „(/on-v°n) 

for all integrable /: R 1 —> K. Since, conditioned on the value of II, the distributions 
pb n and i> n are the same, we can use the tower property to get 

A(i4)=E AB (E AB (l A |n)) =E An (E j>n (l A |n)) 

= E e „ (E &n (i A |n) ■ v o n) = E,> n (i A ip o n) 

for every measurable set A. This shows that tp o II is the required density. | 

Corollary 3.6. Let \x be the stationary distribution of the SPDE © on C([0, 1],K). 
Let n n be the stationary distribution of the finite element equation ([9]) on i 7 . Let 
C be negative and assume f = F' where F £ C 2 (R) is bounded from above with 
bounded second derivative. Then 



\H - fi, n 



I TV 



o{-) 



as n — > oo. 



proof. Let v be the stationary distribution of the linear SPDE (jl]) on C([0, 1],R) 
and let v n be the stationary distribution of the linear finite element equation ([TO]) 
on M. 1 . By construction of the process U in the third statement of lemma ITT21 and 
by the Markov property for Brownian bridges, the distribution of U between the grid 
points, conditioned on the values at the grid points, coincides with the distribution 
of n independent Brownian bridges. By lemma I2~U1 the distribution of U on the grid 
points is given by v n . Thus we have v = v n . Using this equality and lemma 13.51 we 
find 



hu - /i r , 



I TV 



E, 



dv 



dv 



E, 



dfi 
dv 



dVr, 



— O 11 
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Now we are in the situation of equation (fT4"|) and the proof of theorem 13.11 applies 
without further changes. I 



4 Examples 



To illustrate that the suggested finite element method is a concrete and implcmcntablc 
scheme, this section gives two examples for the finite element discretisation of SPDEs, 
both in the context of infinite dimensional sampling problems. 
For the first example, for c > 0, consider the SPDE 

dtu(t,x) = d%u(t, x) - c 2 u(t, x) + V2d t w(t, x) V(t, x) G K+ x (0, 1) 

with Robin boundary conditions 

d x u(t,0) = cu(t,0), d x u(t,l) = -cu(t,l) VieM+, (24) 

where dtw is space-time white noise. From lHairer et aTl ( 2007 ) we know that the 
stationary distribution of this SPDE on C([0, 1], R) coincides with the distribution of 
the process X given by 



dX T 



cX T dr + dW T 
1 s 



Vr G [0, 1] 



(25) 



2c" 



where the time r in the SDE plays the role of the space x in the SPDE. In the 
framework of section [TJ the boundary conditions (|24p correspond to the case «o = 
ql\ = c and /3o = /3i = 1. Since fti ^ 0, we need to include both boundary points in 
the finite element discretisation and thus have / = {0, 1, . . . , n} and M. 1 = R™ +1 . The 
matrix £(«) is given by 



Ax 



f-l- cAx 
1 



V 



1 

-2 1 
1 -2 
1 



1 -1-cAxJ 



n(n+l)x(n+l) 



where the middle rows are repeated along the diagonal to obtain tridiagonal (n+ 1) x 
(n + l)-matrices. Similarly, the mass matrix M is given by 



M 



Ax 
~6~ 



(2 1 \ 
1 4 1 
1 4 1 
1 4 1 

V 1 V 



n(n+l)x(n+l) 



where, again, the middle rows are repeated along the diagonal. Finally, it transpires 
that the discretised drift for this example is given by f n (u) = —cMu. By lemma [2^41 
the n + 1 dimensional SDEs 



dU t = M^L^Ut dt - cU t dt + V2A-r 1/2 dW t 



and 

dU t = L {n) U t dt - cMU t dt + V2 dW u 

where W is an (n + l)-dimensional Brownian motion, both have the same station- 
ary distribution and this stationary distribution converges to the distribution of the 
process X from (|2"S")) in the sense given in theorem 13.11 and corollary 13.61 
As a second example, consider the SPDE 

d t u{t, x) = d 2 x u(t, x) - {gg' + ^g")(u) + y/2d t w(t, x) V(t, x) G M+ x (0, 1) 
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with Dirichlet boundary conditions 



u(t,0) = u(t,l) = VieK+, 

where g € C 3 (M, E) with bounded derivatives g', g" and g"'. From lHairer et al. (2007) 
we know that the stationary distribution of this SPDE on C([0, 1],R) coincides with 
the conditional distribution of the process X given by 

dX T = g(X T ) dr + dW T Vt <= [0, 1] 

x ' L J (26) 

X = 0, 

conditioned on Ii =0. 

Since we have Dirichlet boundary conditions, the boundary points in the finite 
element discretisation are not included: we have J = {l,2,...,n — 1} and K 7 = R" -1 . 
The matrices and M are given by 



(n-i)x(n-i) 



and 

M = — I 1 4 lie r(»-i)x(™-i) 





where, again, the middle rows are repeated along the diagonal to obtain matrices of 
the required size. The discretised drift /„ can be computed from @ ; if an analytical 
solution is not available, numerical integration can be used. By the assumptions on g, 
the function F = ~\{g 2 + g') satisfies the conditions of theorem 13.11 Thus, the 
stationary distributions of the (n — l)-dimensional SDEs 

dU t = M^L^Ut dt + M^UiUt) dt + \/2M" 1/2 dW t 

and 

dU t = L^U t dt + f n (U t ) dt + V2dW t 

coincide and converge to the conditional distribution of X from (j26)) . conditioned 
on Xi = 0. 
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